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ABSTRACT 

The  work  investigates  the  notion  of  separability  in 
continuous  parameter  stochastic  processes.   It  explores  the 
implications  of  relaxing  the  separability  hypothesis. 
Various  numerical  results  are  obtained  for  a  particular 
example,  the  0-1  Markov  process. 
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I.   INTRODUCTION 

Our  aim  is  to  investigate  peculiarities  of  non-separable 
processes.   In  Chapter  II  we  introduce  the  general  notion  of 
separability  for  abstract,  continuous  parameter  stochastic 
processes  following  Doob's  presentation  [2].   We  then 
illustrate  the  concept  in  action  by  studying  the  0-1  Markov 
process,  to  which  Chapter  III  is  devoted.   We  first  define 
the  class  of  measurable  sets  generated  by  the  finite 
dimensional  measures.   Then,  following  Halmos'  presentation 
of  inner  and  outer  measures  and  extensions  [3],  we  extend 
the  measure  in  a  non-unique  fashion  to  a  larger  class  of 
sets.   Each  extension  specifies  a  particular  equivalent 
version  of  our  process,  the  separable  case  being  one  of  the 
collection.   Learning  that  certain  constraints  were  involved, 
we  derive  a  functional  equation  later  in  the  chapter,  and 
such  a  functional  equation  summarizes  all  the  constraints. 
We  then  place  the  non-separable  case  under  a  new  light 
through  the  use  of  a  "factor  function"  which  we  relate  to 
the  probabilities  within  the  non-separable  process.   From 
this  new  vantage  point  we  were  able  to  prove  that  at  a 
particular  parameter  value  either  all  or  none  of  the  sample 
paths  are  continuous.   We  conclude  our  work  with  suggestions 
for  further  study. 


II.   SEPARABILITY 

In  this  section  we  wish  to  present  the  concept  of 
separability  in  stochastic  processes  that  have  a  continuous 
parameter  set.   As  will  be  seen,  such  processes  deal  with 
sets  that  are  not  measurable  unless  certain  conditions  are 
placed  on  the  process.   The  concept  of  separability  gives 
the  required  conditions  enabling  such  sets  to  be  measurable 
Hopefully,  this  section  will  make  clear  the  concept  of 
separability,  as  well  as  the  problem  we  wish  to  present. 

Let  {x, ,teT}  be  a  stochastic  process  with  parameter 
set  T  which  is  any  interval  of  the  real  line.   The  random 
variables  x,  are  defined  on  a  set  ft.   Let  cA.  denote  a  class 
of  closed  sets.   Then  the  process  is  said  to  be  separable 
relative  to  cA  if  there  exists  a  sequence  of  parameter 
values  {t.}  and  a  subset  A  of  ft  of  probability  .zero  such 
that  for  Ae  cA   and  any  open  interval  I  in  T,  the  co-sets 


{xt(w)eA,teI}  {x^.  (oj)eA,t  el} 

J 


differ  by  at  most  a  subset  of  A.   We  will  use  the  term 
"a  separable  process",  acknowledging  that  it  is  with  respect 
to  cA  since  the  context  is  clear.   Also  we  will  call  any 
sequence  {t  }  satisfying  the  conditions  of  the  separability 
definition,  a  separability  set. 


Except  in  pathological  cases  the  separability  set  {t  } 
is  dense  in  T.   If  we  enlarge  our  separability  set  by  adding 
a  countable  number  of  other  parameter  values,  the  new 
sequence  {t . }  is  also  a  separability  set,  since  {t .  }es{t .  }«T. 
Conversely,  if  any  countable  dense  subset  is  a  separability 
set,  we  say  the  process  is  we 11 -separable . 

It  was  worth  questioning  whether  we  could  restrict  our- 
selves to  open  intervals  I  with  rational,  or  infinite, 
endpoints,  and  still  satisfy  the  separability  definition. 
The  question  proves  to  be  true.   Consider  an  interval  (a,b) 

where  a  and  b  are  irrational.   Let  a  ia  and  b  tb,  where 

n        n   ' 

the  a  '  s  and  b  's  are  all  rational.   We  observe  that  for 
n        n 


n>m,  and  any  AecA, 


M  =  {x,  (w)eA.t.e(a  ,b  )}^M  e{x,  (w)eA,t.e(a  ,b  )} 
n     t.      5  j    n'  n    m   t.      J  j    m5  m 


and  show  that 


M  e  {x.  (u)eA,t,e(a,b)}  =  f\   M. 
tj       J         n-1  n 

CO  CO 

Certainly  Ms  fl  M  .   So  take  an  we  fl  M  .   If  w^M,  then  there 

n=l  n=l 

is  a  t.e(a,b)  such  that  xr  (w)fcA.   But  there  exists  an  n 

such  that  t.e(a— ,b— ),  and  weM—  which  gives  us  a  contradiction 
j   n*  n  '        n       & 

Thus  coeM.   Hence,  M  =  [1  H  .   Therefore  in  our  definition 

n-1  n 

of  separability,  it  is  sufficient  to  restrict  the  condition 

to  open  intervals  of  rational,  or  infinite,  endpoints. 


Looking  at  the  two  co-sets  in  our  definition  of 
separability,  we  could  express  the  sets  in  the  form, 

(1)  (x,  (u))eA,teI)  =  fj  {x.(a))eA}      and 

t  tel 

(2)  {x.  (a))eA,t.El}  =   f\  {x.  eA}  . 

The  co-set  (2)  is  the  intersection  of  a  countable  number  of 
measurable  sets,  hence,  the  intersection  is  measurable. 
Though  each  co-set  in  the  intersection  of  Equation  (1)  is 
measurable,  this  is  not  enough  to  show  that  the  intersection 
is  measurable,  since  the  intersection  is  over  an  uncountable 
number  of  sets.   However,  because  of  the  separable  condition, 
co-set  (1)  has  the  same  probability  as  co-set  (2).   This 
subject  of  countable  or  uncountable  operations  seemed  to  be 
the  main  problem  in  the  non-separable  processes  we  considered; 
once  we  leave  the  countable  realm,  we  become  very  dependent 
on  the  concept  of  separability. 

Now  consider  the  operations  of  greatest  lower  bound, 
gib,  and  least  upper  bound,  lub,  and  suppose  our  process 
is  separable.   Choose  an  co  not  in  the  null  set  A.   Then  for 
a  separability  set  {t.}  ,  and  any  open  interval  I,  we  can 
find  an  a  such  that 


a  =  gib  x,  (co ) ,      -°°  _<  a. 

If  b   =    gib      x    (co~) ,    we   wish  to    show  that    a  =   b   using  the 
tel        z 


separability  definition.   Certainly  b  £  a.   Assume  b  <  a, 
then  consider  the  Go-sets, 


{x,  (oo)e[a,°°]  ,tel}    and    {x,  (oj)e[a,°°]  ,t  .el}  . 
t  t.  j 


By  the  definition  of  separability,  the  two  oo-sets  differ 

only  by  a  subset  of  A,  and  since  go  is  not  in  the  first 

oo-set,  but  is  an  element  of  the  second,  go  must  be  in  A, 

which  is  a  contradiction.   Therefore,  a  =  b,  or,  more 

specifically,  gib  x  (go)  =  gib  x   (go)   for  all  oo^A.   In 
tel         t.el   j 

a  similar  fashion  we  could  show  that  lub  x,  (oo)  =  lub   x,  (go) 

'  tel         t.el  z3 

for  all  go  ^  A.   In  particular,  if  to  ^  A  and  if  t  e  I,  then 

gib   x.  (to)  =  gib  x  (oo)  <_  Xr-(oo)  ,   and 

t.el  rj      tel  Z  Z 

J 

xr-(oo)  <_  lub  x  (go)  =  lub-  x   (oo) .   Thus, 

z  tel  z  t.el  rj 

J 


(3)     lim  gib    ,   x   (go)  <  xr(to)  <  lim  lub    -,   x.  (oo), 
n^o  |trt|<i   fcJ  -n-  |trt|<i  zj 

GO  $  A  . 


A  classical  theorem  concerning  separability  utilizes  (3), 

stating  that  if  a  process  is  separable,  and  a  sequence  {t . } 

J 

satisfies  (3)  for  every  t"  e  T,  then  the  sequence  is  a 
separability  set.   If  we  place  the  further  condition  that 
if  for  every  t"  e  T  we  have 


(l\)  p  lim  x,  =  xtt      (convergence  in  probability), 

->t 


then  any  countable  dense  subset  of  T  is  a  separability  set, 
This  is  true,  for  if  we  take  any  countable  dense  subset  of 
T,  it  satisfies  condition  (4)  by  hypothesis.   Thus,  this 
subset  satisfies  (3).   Therefore  the  process  is  well- 
separable. 

Showing  that  gib   x,  (go)  =  gib  x,  (go)  and 

t .  e  I   j      t  e  I 
j 

lub   x,  (go)  =  lub  x,  (go)  for  all  I  open,  go  £  A,  in  the 
t.el   j      tel  Z 

separable  process,  we  obtain  another  natural  result:   For 

go  £  A 


(5)     lim  inf  x,  (go)  =  lim  gib      x   (go) 

t.+t    j      n-*»  |t,-t|<l  rj 
J  J    n 

=  lim  gib      x,  (go)  =  lim  inf  x,  (go) 
n-*°o  |t.-t|<l  z  t+t 

J    n 

and 


(6)     lim  sup  x,  (go)  =  lim  lub      x   (go) 

t,+t   zj  n+~  |t  -t|<l  zj 

J  J    n 

=  lim  lub_    x,  (go)  =  lim  sup  x,  (go) 
n^  |t-t|<l  t+t 

n 


.Thus,  in  the  separable  process,  lim  inf  x,  (go)  and 

t+t    Z 

lim  sup  x,  (go)  are  random  variables.   With  this  result,  the 
t-t    Z 


probability  of  events  concerning  limits,  strong  continuity, 
etc.,  may  be  expressed  in  terms  of  probabilities  of  lim  inf's 
and  lim  sup's,  and,  hence,  is  determinable. 

Now  there  is  the  question  of  whether  or  not  any  stochastic 
process  can  be  made  separable,  without  changing  the  character 
of  the  process  to  any  appreciable  degree.   In  other  words 
we  are  speaking  of  equivalent  processes;  a  process  {x,  ,teT} 
is  equivalent  to  the  process  {x,  ,teT}  if  and  only  if 
P{x,  (to)  =  x,  (to)}  =  1,  for  each  t  e  T.   So  restating  the 
question,  for  each  stochastic  process  (x,(to),  teT}  does 
there  exist  an  equivalent  process  {x.  (to), teT}  such  that  the 
x-process  is  separable?  We  will  show  that  the  statement 
is  true. 

As  is  necessary  in  the  definition  of  separability,  we 
must  find  a  separability  set  and  a  null  set  A.   Our 
separability  set  will  be  formed  by  construction,  and  then 
from  this  separability  set  we  will  describe  parts  of  our 
null  set . 

First,  we  show  that  for  each  closed  set  A,  we  can  find 
a  sequence  t,  ,  t?,  ...  such  that 


(7)     P{xt  (to)eA,n>_l;xt(to)  \k}    =  0    for  each  teT. 
n 


So  take  a  closed  set  A.   Now  choose  any  finite  sequence 
t,,  ...,  t,  of  parameter  values.   Define 


10 


G,  t  =  {x.  (u>)eA,n<_j  ;xt(u))$A}  ,     and 


p,  =  lub  P(G.  , ) 


We  note  that  for  a  fixed  t,  the  G.  ,  's  form  a  decreasing 
sequence  of  sets,  implying  that  p,  >.  p?  >_  .  .  .    If  p,  =  0, 
then  we  have  found  the  desired  sequence  for  the  particular 
closed  set.   If  p,  >  0,  by  the  definition  of  lub,  there 
exists  a  x  such  that  P(G,   )  >_  P^Cl  -  tt)  s    and  we  let 
ti  , n  =  t.   Then,  by  induction,  we  form  an  infinite  sequence 
t..  ,  tp,  ...    Assume  that  p,  >  0,  for  all  k.   For  each  t, 
we  have 


(8)     P{xt  (co)eA,n>l;x  (w)^A)  <  lim  pk. 
n  k-x» 


Consider  the  co-sets, 


H  =  {x   (oj)eA,n£k;x,    £A}  . 
K      n  ^k+1 


Since  the  H  '  s  are  disjoint,  the  probability  of  their  union 

equals  the  sum  of  their  probabilities,  implying  that 

lim  P(H.  )  =  0.   But  by  definition,  P(H,  )  >  p,  (1  -  £■) ; 

thus,  lim  p,  =  0.   From  (8), 
k-><» 


P{x,  (u))eA,n>l;x.  (w)iA>  =  0  ,     for  each  t  e  T, 


11 


and  so  we  have  found  the  desired  sequence  for  a  particular 

closed  set  A. 

Now  let  cA  be  the  class  of  sets  which  are  finite  unions 
o 

of  closed  intervals  with  rational  or  infinite  endpoints. 
If  cA  is  the  class  of  sets  which  are  intersections  of  se- 
quences of  sets  in  cA  ,  then  *A  includes  all  the  closed 
sets.   By  the  preceding  paragraph,  for  each  A  z    cA  there 
corresponds  a  particular  parameter  sequence  such  that  (7) 
is  true.   Since  there  is  a  countable  number  of  closed  sets 

in  cA  ,  we  let  {t  }  be  the  union  of  all  the  corresponding 
o'         n  v  & 

sequences.   Let 


A.(A)  =  {x,  (w)eA,n>l;x,  (w)iA>  ,    and 
t        tn       -       X, 

h.    =   U    A.  (A)  . 
AscA0   t 

We  note  that  P(A, )  =  0,  since  there  are  only  a  countable 

number  of  A,(A)'s  to  consider,  each  of  which  has  probability 

0.   Now  if  A  e  cA ,  and  A   e  tA  such  that  A  «  A  ,  then 

i  o     o  o3 

(9)      {x   (a))eA,n>l;x  (w)$A}  o  {x   (to)eA  ,n>l  ;xt  (03)  ^A#}  «  ^ 
n  n 

The  implication  then  follows,  since  each  CA-set  is  an 
intersection  of  cA.  -sets. 

Now  let  I  be  an  open  interval  with  rational  or  infinite 
endpoints,  with  I  <=  T,  and  then  restrict  our  process  to  the 


12 


process  (x, ,tel).   For  this  restriction,  we  let 

{t  )T  =  {t  }  A  I.   Then  by  our  previous  results,  there 

exists  an  w-set  A,  T,  such  that 

z  ,1 


Let 


P(A,  T)  =  0    for  each  t  e  I,    and 
z ,  i 


{xc.(a))eA,se{t  }T;x,  (cd)£a}  <^  A,  T ,    for  each  A  e 
s  n  -L  z  z  y  I. 


S  =   U   (t  }T,    A,.  =   U   A,  T   where  I   is 
I      n  I'    t   l£l   t,I 


cA 


r  r 


the  class  of  all  open  intervals  in  T  with  rational  or  infinite 
endpoints,  implying  I   is  countable  class  of  open  intervals. 
For  a  fixed  w,  we  define  A(I,w)  to  be  the  closure  of  the 
set  of  values  of  x  (oj)  where  s  varies  in  I  fl  S.   The  values 
of  ±<»  may  be  in  A(I,u).   This  set  is  closed  and  non-empty, 
and  we  note  that 


x.  (u))eA(I,u))    if    teljCo^A.. 


Defining  A(t,w)  =  f\      A(I,a)),  we  know  that  A(t,ui)  is  closed, 

let 
and  since  we  have  made  the  class  of  A(I,oj)!s  compact  by 

including  the  values  ±°°,  A(t,co)  is  non-empty.   So 


x.  (w)eA(t,iu)     if    teT,o)^At. 


13 


Thus,  we  define  our  x-process  by, 

J  x.Cw)    if   t  e  S 
x.  (to)  =  S 

xtU)    if   t  |  S   w  £  At 

^  any  value  in  A(t,to)    if  t  (  S,  u  e   At . 

We  now  want  to  show  that  the  x-process  is  separable,  and 

equivalent  to  the  original  x-process.   Certainly 

P{x,  (to)  =  x,  (to)}  =  1,  implying  that  the  two  processes  are 

equivalent.   Now  let  A  e  cA  ,  and  suppose  that  I  e  I   and 

03  is  such  that  x  (to)  e  A   for  all  s  e  I  fl  S.   Hence,  by 

s 

definition  A(I, to)   <=   A.      So   if  t    £   I,    then  by   our    construction 
of  x, 

x.  (to)    =    x,(to)    e        A(I,to)  c   A      if     t    e   S,      or      t$S,io$At 

A(t,to)   <=  A(I,to)   <=■  A      if      t£[S,toeAt. 


Thus, 


(10)     {xs(to)eA,seiriS}  =  '  {xt  (w)eA,teI}  . 


By  a  previous  argument,  we  know  that  we  can  restrict  the 
definition  of  separability  to  open  intervals  with  rational 
or  infinite  endpoints.   Therefore  our  x-process  is  separable, 
and  thus,  every  stocahstic  process  has  an  equivalent, 
separable  process. 


m 


It  is  important  to  note  some  characteristics  of  this 
constructed  separable  process  before  leaving  this  section. 
Though  it  may  be  too  strong  to  say  that  the  null  set  A  of 
this  process  is  the  void  set,  it  is,  nonetheless,  true  that 
for  all  open  intervals  I  in  T  and  A  in  cA  ,  the  two  co-sets 


{x  (co)eA,s£lAS}    and    {x.  (u))eA,teI) 

S  1/ 


differ  by  a  void  set.   The  construction  has  eliminated  from 
the  x-process  all  sample  paths,  characterized  by  an  to, 
which  behave,  in  some  sense,  badly.   There  are  possibly  an 
uncountable  number  of  separable  processes  equivalent  to  the 
x-process,  but  this  x-process  is  the  best  one  can  hope  to 
have,  in  the  sense  that  every  sample  path  behaves  well. 
Thus,  this  x-process  represents  one  extreme  of  the  class 
of  all  processes  equivalent  to  the  x-process.   It  is  fair 
then  to  ask  what  process  represents  the  other  extreme. 
Because  of  the  abstractness  of  our  sample  paths,  we  delay 
this  question  until  a  later  section,  where  we  consider  a 
particular  process  in  which  the  sample  paths  are  easier  to 
picture . 


15 


III.   THE  0-1  MARKOV  PROCESS 

In  considering  the  separability  concept,  the  continuous 
parameter  process  we  will  study  is  the  0-1  Markov  process 
{x,  (oo)  ,te[0,t  ]},  where   t   <  «>.   In  such  a  process,  whether 

X/  o  o 

separable  or  not,  certain  finite  dimensional  probability 
properties  are  true.   Define  p..(s,t)  to  be  the  transition 
probability;  that  is. 


p..(s,t)  =  P{x,  (oj)  =  j  I  x  (o))  =  i>,   where  0<s<t<t  , 

1J  u  S  O 

i,je{0,l}, 

and   P{x(u))=i}>0. 
s 


For  our  process,  the  transition  probabilities  have  the 
stationary  property  that  p..(s,t)  depends  only  on  the 
difference  t  -  s,  and  we  may  write  the  transition  probability 
as  p..(t-s).   Further,  these  transition  functions  can  be 
derived  and  are  of  the  form: 


p   (t)  =  a  +  be_t       p  -.(t)  =  b  -  be  t 


oo  *ol 

»11(t)  =  b  +  ae~        p1Q 


— t  -t 

pin(t)  =  b  +  ae        pin(t)  =  a  -  ae 


where  a,b  >  0,  and  a  +  b  =  1. 


16 


A..  THE  SEPARABLE  0-1  MARKOV  PROCESS 

Now  let  us  suppose  that  our  process  is  separable.   It 
can  be  shown  that 


P{x  (co)Ei,t<t<t+a|x"(o))  =  i}  =  e"qia 


b    if   i  =  0 
where   q.  = 

a   if   i  =  1  . 


We  know  also  that  each  sample  path  in  which  there  exists 
an  instantaneous  jump  from  one  state  to  another  has 
probability  0.   In  particular,  sample  paths  of  the  form, 

{xt(w)=0,te[0,t];xt(w)=l,te(t,to], |xo(w)=0} 

have  probability  0.   However  if  we  take  the  probability  of 
the  collection  of  all  such  sample  paths  (that  is,  the 
probability  of  exactly  one  transition  in  the  interval 
[0,tQ]),  we  obtain  ^ra^"ato   "  e"bto)-   If  b  =  a  =  |, 
the  probability  is  derived  by  taking  the  limit  as  b  and  a 
both  approach  %,  and  the  probability  is  %t  e  2  o.   These 
probabilities  are  conditioned  on  the  event  that  x  (w)  =  0. 

If  we  condition  them  on  the  event  that  x  (oj)  =  1,  the 

o       5 

probability  of  exactly  one  transition  in  the  same  interval 

is   -  a  .  (e"bto  -  e"ato),   and  again  if  a  =  b  =  H3   we  get 

a  ■■"  u 

kt   e  2  o  .   As  will  be  seen  later  in  this  section,  these 
o  * 
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probabilities  are  bounds  for  the  arbitrary  probabilities 
that  may  result  from  the  same  events  in  the  non-separable 
processes.   Other  "separable"  probabilities  for  different 
events  could  also  be  calculated,  but  those  mentioned  above 
will  suffice  for  our  discussion  of  the  non-separable  process, 

B.   THE  NON-SEPARABLE  0-1  MARKOV  PROCESS 
1.   Extension  of  the  Measure 

The  finite  dimensional  probabilities  yield  a 
measure  for  events  involving  a  countable  number  of  parameter 
values.   The  collection  of  all  these  events  will  be  the 
o-algebra  S,  with  the  probability  measure  y.   We  now  wish 
to  prove  and  apply  the  following  extension  theorem: 

Theorem:   If  M  e  S,  there  exists  a  (non-unique) 
probability  measure  y,  an  extension  of  y,  defined  on  the 
a-algebra  S  generated  by  the  sets  in  S  and  the  set  M. 

Proof:   We  first  show  that  cA  =  {(EftM)U(FnMf  )*.E,FeS} 
is  the  a-algebra  S  that  we  are  looking  for  in  the  theorem. 
Since  X,<J>  e  S,  we  have  that  M  =  (xnM)U  (MM'  )ecA .   Also, 
for  all  EeS,  it  follows  that  E  =  (EflM)U(EflM' )ecA  ,   implying 
that  S  c  cA  .   Thus,  cA  is  in  a  sense  generated  by  the  sets 
in  S  and  the  set  M.   Now  we  must  show  that  cA  is  a  a-algebra, 

Let  A..,  Ap,  ...  e  cA  ,  implying  there  exist 
E.j  ,  Ep,  ...,  F,  ,  Pp ,  ...   e  S,  such  that 

Ax  =  (E1AM)U(F1AM'),  A2  =  (E20M)U  (FpAM'  )  ,  ...   Since 
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U   E  eS  and  [\      F  eS,   we  have  that 
n=l  n=l 

U  k     -  [(  S   Em)AM]UC(  U   F  )flM']ecA.   Also  if 
n=l  n     n=l  n       n=l  n 

A  =  (Ef\M)U(Pl\Mt)ecAi  then 

A1  =  [(EflM)U(FAM')]'  =  (ETUMf  )n(PfUM)  =  (E  'fl  F»  )U  (E  'ft  M)U  (F'ft  M1  ) 

=  (E'nM)U(FfAM)ecA.   Therefore,  cA  is  a  a-algebra. 

Let  mK  and  m*  denote  the  inner  and  outer  measure, 

respectively,  with  respect  to  measure  u.   If  m#(M)  =  a  >  0, 

then  there  exists  for  each  n  a  G  e   S  such  that  G  <=  M 

n  n 

and  a  -  -  <  U(G  )  <  a.   Let  G  =  U   G  .   Certainly  G  <=  M, 
n  —  M  n  —  ,   n  J       ' 

and  G  e  S.   Further,  by  the  definition  of  inner  measure, 
m#(M  -  G)  =  0.   Now  if  m*(M)  =  b  >  0 ,  in  a  similar  fashion 

CO 

we  can  find  a  sequence  of  H  fs  in  S  such  that  if  H  =   0  H  , 

n  "-   nJ 

n=l 

then  M  <=   H,  and  m^(H  -  M)  =  0.   Thus,  we  have  found 

G,H  E  S  such  that  G  e=  M  c  H  and  y(G)  =  m*(M)  and  m*(M)  =  y(H). 

Now  let  D=H(1  G1,  and  let  A  =  (EflM)U (FOM1 )  e  cA  . 
Then  AOD1  =  (EAMHD1  )U.(FAM,nDI  )  =  (EnG)U(FnH')  e  S.   Thus, 
for  all  A  e  cA  j   A  (\  Df  e  S.   We  may  rewrite  mt(M-G)  =  m*(DflM) 
and  m#(H-M)  =  m^(DnM').   So 

m*(DflM)  =  m*(Df\M)  +  m^(DaM')  =  y(D)  =  m^CDflM')  +  m^(DHM) 
=  m*(DnM' ). 

Let  A1  =  (EinM)U(FinM')  and  A2  =  (E2ftM)U  (F^M'  ) ,  with 
A,,  Ap  ecA  .   Suppose  A,HD  =  ApflD.   Then  it  must  follow  that 
(E^MHD)  =  (E^MHD)  and  (F^M'flD)  =  (F^M'HD).   If  (E^D) 
and  (EpOD)  disagree,  then  their  symmetric  difference, 
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(E  nD)A(E2f\D) ,  is  a  subset  of  M'.   Thus, 

(E-^DUCE^D^DnM1  .   Hence,  y  ( (E-jHD)  A  (E^D) )  <mx(M'fl  D)  =  0. 
Therefore,  y(E.,fiD)  =  yCEpOD).   In  the  same  fashion  we  can 
show  that  yCFJID)  =  y(F2HD). 

Now  we  define  our  extended  measure  y  on  the  a-algebra 
cA.   Let  a,B  >  0,  with  a  +  £  =  1.   Then  for 
A  =  (Ef\M)U  (FflM1  )  e  cA  ,  y  is  defined  by, 

y((EnM)U(FAM'))  =  y([(EnM)U(FnM')]nD')  +  ay(Ef)D) 

+  8y(F0D). 

By  the  preceding  paragraph,  such  a  measure  is  well-defined, 
and  certainly  for  all  A  e  cA  ,   y(A)  >_  0 .   If  A  =  <J>,  then 

\i(<$>)    =  y([UnM)U(<j>nM')]flD')  +  ctyUnD)  +  MMD) 

=  y(<j>)  +  oy(<J>)  +  By(<J))  =  0. 

- 

Now  let  {A  >  be  a  disjoint  sequence  in  cA ,  where 
n 

A  =  (E  AM)  (F  HM').   Then, 
n     n      n  ' 
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y(  U  A  )  =  y((  U  En  M)U(  U  Fn  M')) 
n=l  n       n=l  n     n=l  n 


■  U(C(  U  E  OM)U(  U  P  nM')]flD')  +  ap(  U  E  J|D) 

n=l  n     n=l  n  .  n=l  n 

00 

+  Sy(  U  FOD) 
n=l  n 


y(  U  C(E  nMOD')li(F  OM'nD')])  +   E  ay(E  flD) 
n=l  '   n         n  n=l    n 

00 

+  Z  By(F  HD) 
n=l 


Z  (y[((E  HM)U(F  nMM)AD'])  +   Z  ay(EHD) 
n=l      n      n  n=l    n 

oo 

+   Z  3y(F  flD) 
n=l    n 


Z  (y[((E  nM)U(F  nM'))(\D']  +  ay(E  AD) 
n=l      n      n  n 

+  3y(PnnD)) 


=   Z  y(A  ). 
n=l   n 


Thus,  y  is  a  measure  on  cA .   Further,  since 

(EnM)U(EflM')  =  E  e  S, 

y(E)  =  y(EnD')  +  (a+B)(y(EflD)  =  yCEAD1)  +  y(EftD)  =  y(E). 

Hence,  y  =  y  on  S.   Also,  since 

y(M)  =  y(MnD')  +  ay(D)  =  y(G)  +  ay(HnG')  =  y*(M)  +  ay(HHG') 

If  a  =  1,  then  y(M)  =  y(G)  +  y(Hf\GT)  =  y(H)  =  y*(M). 

Therefore,  y*(M)  <_  y(M)  <_  y*(M),  depending  on  a  (and  £)  . 

Setting  S  =  cA,  we  have  proved  the  theorem. 
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Now  suppose  we  have  a  countable  sequence  of  sets, 

ML,  M?,  ...,  not  in  S.   Let  S  (M   _)  be  the  extended 

a-algebra,  S  - ,  generated  by  the  sets  in  the  a -algebra  S 

and  the  set  M  . ,  .   It  follows  that, 
n+l 


S  c  S1  =  S(M1)  c:  S2  =    S1(M2)  c 


Let  T  =   US.   If  A  and  B  are  in  T  ,  then  there 

n=l 

exist  a  j  and  k  such  that  A  e  S.  and  B  e  S,  .   Without  loss 

J  k 

of  generality,  we  can  assume  j  _>  k.   Then  B  e  S..   Thus, 


AUBeS.^M".   Certainly  if  C  e  4  ,  then  C  e   Sp   for  some  I, 
implying  that  C  e  S -  c  +  .   Therefore, t  is  an  algebra. 
The  measure  we  apply  to  T  is  u   defined  by 


u  (A)  =  yk(A)    where  A  e   S,  ,  and  y.  is  the  measure 

on  S.  . 

k 


We  now  apply  the  Caratheodory  Extension  Theorem: 

Theorem:   Let  y  be  a  measure  on  an  algebra  dy    and 
y*  the  outer  measure  induced  by  y.   Then  the  restriction 
y  of  y*  to  the  y*-measurable  sets  is  an  extension  of  y  to  a 
a-algebra  containing  d .   If  y  is  finite,  so  is  y.   If  y 
is  a-finite,  then  y  is  the  only  measure  on  the  smallest 
a-algebra  containing  d.  which  is  an  extension  of  y. 
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We  relate  this  extension  by  considering  the  M-sets 
associated  with  intervals  in  [0,t  ].   For  any  open  interval, 
(r,s)  where  r  and  s  are  rational,  we  define, 

Ml  (r  s)  ~    ^xt^w^  =  1  on  ^r>s^  >        and 
7?K  =  {M   ,    x|r  and  s  are  rational}  . 

Defining  fl/  similarly,  we  let  W{  =  7I}Q   13  77^. 

Let  S  be  the  a-algebra  of  all  sets  which  are 
measurable  by  our  finite  dimensional  probabilities.   Since 
the  class  7l\   is  countable,  by  the  two  extension  theorems 
above  there  is  a  a-algebra  }J  containing^?  and  S.   Thus,  the 
7W-sets  are  now  measurable.   Also  this  extension  j/  has  pro- 
duced additional  M-sets,  namely  those  associated  with  open 
intervals  with  irrational  endpoints,  so  these  are  also 
measurable.   Such  an  M-set  is  generated  by  the ^intersection 
of  a  countable  numbers-sets.   It  is  crucial  to  realize 

that  if  r  \   r  and   s   +  s,  then 
n        co   n    ' 

lim  Ml  (r  s  )  =  ^Mi  fr  s  )  =  M2  (r  sV   Also> 


P(M,  ,    v  -  M,  r    -,)  = 
l,(r,s)    l,[r,s]' 


P([{xr(W)  =  0}nMlj(rjS)A{xs(cu)  =  l}]U[{xr(W)  =  l}f\Mlj(rjS) 

n{xs(a3)  =  0}]U[{xr(a))  =  xs(W)  =  0}aM1}(rjS)]) 
0,   by  properties   of  the  Markov  process. 
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Hence,  P(M,  *   _>)  =  P(M,  r    -> ) .   Similarly,  the  same  result 

is  obtained  for  any  M  -set. 

o 

Let  m  be  the  measure  defined  on  S,  and  mx  and  m*  be 
the  inner  and  outer  measure,  respectively,  with  respect  to 
the  sets  in  S.   For  any  open  interval  I,  m#(M,  T)  =0, 
since  the  only  set  in  S  contained  in  1VL  j   is  the  void  set. 
It  is  to  be  noted  also  that  in  the  separable  case, 
P(IYL  T)  =  m*(IVL  T).   However  in  the  non-separable  case,  by 
the  first  extension  theorem,  the  most  we  have  for  the 
probability  of  ML  j  is, 

0  =  mt(M1  r)  <  P(M1  z)    <  m*(M1  x)    =  P(M1  -j-) 

where  P  denotes  the  probability  in  the  separable  case. 

.A, 

Suppose  PCI^  (r  s))  =  6P(M1  ,   s)).   It  is  easily 
shown  that  P(M1  (p  s)|xr(u)  =  1)  =  6P(M;L  ^  (p  g)  |xr(u)  =  1). 
Therefore,  hereafter  when  we  evaluate  the  probability  of 
an  M-set,  we  are  evaluating  the  conditional  probability  of 
the  set,  conditioned  on  the  initial  value.   Thus, 


-q  |I|  Jb    if    i  =  0 

=  e       ,   where  q.  =*\ 

1   (^a   if   1  =  1. 


P(M.   )  =  e 
-1-  »■*- 


Also,  henceforth,"/??  will  be  the  class  of  all  M.  T  regardless 
of  the  type  of  interval  I. 

2.   Inclusion  of  the  1-Transition  Sets 

From  the  preceding  section,  we  have  shown  that  all 
sample  paths  which  are  constant  (0  or  1)  on  an  open  interval 

2k 


are  measurable  in  j/,  with  the  measure  being  somewhat  arbitrary. 
(We  will  see  in  later  sections  that  there  are  other  restric- 
tions on  the  measure.)   In  this  section  we  wish  to  show  that 
all  sample  paths  making  one  transition  between  parameter 
values  0  and  t   can  be  described  by  these  /#-sets,  hence, 
are  also  measurable. 

We  use  the  following  notation: 


pn  kt 

Mo,k  E  {*tM   =  °   on  [0>7T)} 

pn  (k+l)t 

Ml,k+1  E  UtM   '   1   on  (-7T-^'to]} 

k  2n     2n   ~   2n 
M  »    EM     H  M 
1      u0,k  M  ul,k+l 

2n    2n-2   .  2n 

1     k=l    -1 

2n 
We  now  show  that  the  lim  M    exists.   It  is  sufficient 

n->°° 

;2n  _  .  .   „2n   „       ^-  „2n 


to  show  that  lim  M   £  lim  M   .   Let  to  e  lim  M   .   Then 

2F 

w  e  M,   for  some  n.   Further,  there  exists  an  n!  >  n  such 

2nt  k  2n  k'  2n' 

that  io  £  M1   .   Thus,  u  e  Mr"*    and  w  e  M^  »     for  some 

k  and  k',  with  the  added  condition  that 


kt    k't    (k'+l)t    (k+l)t 
2n     2n'      2n'        2^ 
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Then  we  can  find  a  k  such  that 


kt    kt     k't    (k'+l)t     (k+l)t     (k+l)t 
2n    2n+l   2n'     2n!        n+1        n 

.  2n+l    2n+l  n 

Thus,  to  e  M  '     c=  m     .   Hence,  by  induction,  w  e  M^ 

2n 

for  all  n  >_  n.   So  w  e  lim  M   ,  implying  that 

n+°° 
2n        2n  2n 

lim  M,  S  lim  M1  .   Therefore  lim  M.   exists. 


Let  A  =  {x,  (to)  =  0  on  [0,t )  ,x,  (to)  =  l  on  (t,t  ],  for  some  t} 

We  note  that  A  is  the  collection  of  all  sample  paths  which 

makes  only  one  transition  to  1  in  the  interval  [0,t  ]. 

2n 
We  now  want  to  show  that  lim  M1      =  A. 

For  to  e  A  and  t(to),  we  can  find  a  positive  integer 

N  such  that  for  each  n  >  N,  there  is  a  k  satisfying 


k  t        (k  +l)t 
-2-2.  <  t  <  —2 2. 


2n         2n 

2n  2n 

Thus,  to  e  M    for  all  n  >  N.   Hence,  co  £  lim  M   ,  implying 

n->oo 

2n 
that  A  s  lim  mJ  . 

n-*-co 

2n 
For  to  e  lim  ML  ,  there  is  a  positive  integer  N  such 

that  for  each  n  >  N,  there  is  at  least  one  k  such  that 

k  ,2n 
a)  e  M,     .   In  particular  we  can  find  a  sequence  of/^-sets, 
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M1n    =»  M1n        =•  M1n  *      =»  .  .  .   with  a)  e   MXJ 
for  all  j  >  N.   It  must  follow  that 


Let 


k  t    k  ,,t    k  ,0t  (k  +l)t 

no.   n+1  o  .   n+2  o    .  .no       , 

—  i  -p^nr  i  -55+2-  <  •  •  •  i  — and 


(k  +l)t    (k  ,.+l)t    (k  .0+l)t         k  t 

n    o  >   n+1    o     n+2    o  n  o 

2n     -     n+1    -    2n+2    -  *  *  *  -  2n 


k  t  (k  +l)t 

lim  -2-2.  =  r   and   11m  — EL 2.  =  s 

n-x»  2  n-*00   2 


Certainly  r  <  s.   If  r  <  s.  we  can  find  an  n  and  k—  such 

J        —  y  n 

that 


k-t     (k-fl)t 
r  <  _n_o  <  _n_ o  <  s 

pn       2n  — 

k-,2n 

n 
which  gives  a  contradiction  since  w  e  1VL     .   Thus  r  =  s. 

2n 
Therefore  u  e  A,  implying  that  lim  M   £  A.   Hence 

2n 
lim  NT   =  A. 


From  this  proof  we  know  that  the  collection  of 
1-transition  sample  paths  in  the  interval  [0,t  ],  with 
x  (a))  =  05  can  be  expressed  in  terms  of  our^-sets.   We 
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can  use  the  same  procedure  with  the  1-transition  sample 

paths  beginning  with  x  (w)  =  1. 

It  must  be  noted  that  it  was  just  for  convenience 

that  we  used  those ^-sets  related  to  the  open  intervals 

with  dyadic  rational  endpoints.   We  could  have  just  as  well 

chosen  any  other  sequence  of^-sets  whose  respective  open 

interval  endpoints  become  dense  in  [0,t  ].  Then  in  the  same 

fashion,  express  A  in  terms  of  this  new  sequence.   Further, 

s 
if  (M-.n}  denotes  the  new  sequence, 

s  pn 

lim  M  n  =  A  =  lim  NT  , 
n-*-00  n~*"°° 

s 

implying  that  the  measure  that  is  obtained  by  using  {M  n} 

2n 
is  equal  to  the  measure  obtained  by  using  (IVL  }.   We  also 

have  that   0  =  m#(A)  <  P(A)  <  P(A)  =  ^-  (e"ato  -  e"bto), 

since  each  of  the  7?£-sets  that  express  A  is  bounded  below 

by  0,  and  above  by  its  separable  probability. 

For  k  >  1,  the  k-transition  case  can  be  handled 

similarly.   We  will  show  the  basic  construction  for  the 

2-transition  case.   We  use  the  following  notation: 


Mq   e  {xt(o))  =  0  on  [0,-^)} 
,n  Q  +  l)t   kt. 


,2      _  r   /  n_-,     /  _    o    b 
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^     S  (xt(.)  =  l  on  (— 


9n  (k+l)t 

^,0  E  {xt(w)  =  0   on  (— n— "'V1 
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1  k  2n     2n      2n        2n 

2  -   0,j  "   l,j,k  "   k,0 

n   2n-4    2n-2   .  .  0n 

Hf   s  .  U    (   U    jd'*'^  ) 
*    3-1   k=j+2  d 

A  =  {xt(u))  =  0  on  [0,t);xt(w)  =  l  on  (t,t); 

x.  (o))  =  0  on  (t,t  ]   for  some  t,t} 

2n 
As  before,  we  show  that  lim  M?   exists  and  equals  A,  which 

is  the  collection  of  all  sample  paths  that  make  two  transi- 
tions in  the  interval  [0,t  ].   Though  we  leave  out  the 
proof,  such  a  limit  does  exist  and  in  fact  equals  A.   All 
finite-transition  sample  paths  can  be  expressed  in  a  similar 
manner,  and,  hence,  are  measurable  with  respect  to  the 
measure  of  the  ^-sets  that  express  them. 
3.   Arbitrary  Assignment  of  Measures 

We  have  now  reached  the  heart  of  our  work.   In 
working  in  the  non-separable  process,  the  probability  of 
an  event  may  be  any  value  between  the  inner  and  outer 
measure  with  respect  to  the  sets  in  S,  which  is  the  a-algebra 
before  we  extended  to  include  the  ^-sets .   However,  in 
assigning  an  arbitrary  measure  to  a  set,  we  have  (implicitly) 
affected  measures  of  other  related  sets.   As  an  example, 
consider  the  set, 


M 


l,(r,s)  =  <xt>)  =  1  on  <r>s)} 
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Let  P(M)  denote  the  separable  probability  of  the  set  M. 
Again  we  are  reminded  that  all  probabilities  of  M-sets, 
hereafter,  are  the  conditional  probabilities.   Now  suppose 
that  in  a  particular  process  we  had  that, 

PCI*1.(p.b)J  =  ^'"Kr.s)'   where  0  1  «  <  1- 

Take  an  interval  which  contains  (r,s),  say  the  open  interval 

(c,d).   Then  we  know  that  NL  ,   , >,  s  m, ,    N 

*  l,(c,d)    l(r,s),  and 


P(M-,  /   .J  =  P(M,  /    x)  P(Mn  ,    0  P(M,  ,       ,*) 
l,(c,d)'      l,(c,r)'    l,(r,sr    l,(s,d)y 


"  ««l,(.,r)'  aP(M1,(r)5)>  vP(Mlj(s>d)) 


<  aP(M1  ^  d^),   since   3,y  e  [0,1]. 


Thus,  the  probability  of  all  subsets  of  M,  /    %  have  been 

-L  >  v.  r ,  s  j 

affected,  since  in  this  example  a  <  1.   Now  consider  a 
subinterval  of  (r,s),  say  (e,f).   We  have  that 

Ml,(r,s)  SMl)(e,f)'  and  that 


P(Ml,(r,B))  =  ^l.Cr.e)5  ^.(a.f)'  ^"l.Cf.s)* 


"  6lP(M1,(r,e))  "^.(..f)'  V^.Cf,.)) 

=  ■iWWi.tr,,)1 
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where  a  ,  3_,  y     e  [0,1]  and  a.p.y  =  a  <  1.   Since  a  ,  $  , 
and  Y-,  cannot  all  be  equal  to  1,  at  least  one  of  the  supersets 

Ml,(r,e)>  Ml,(e,f)'  Ml,(f,s)  containing  M1>(l,jS)  has  a 

probability  less  than  its  separable  probability,  and  its 
corresponding  factor,  a  ,  $-,  ,  or  y.  ,  must  be  greater  than 
or  equal  to  a.   Thus,  assigning  an  arbitrary  measure  to  a 
set  may  or  may  not  affect  the  probability  of  a  superset, 
but  at  least  one  superset  must  have  a  probability  less  than 
its  separable  probability. 

Since  we  extended  our  a-algebra  S  to  include  the 
77(-sets,  our  first  concern  in  assigning  probabilities  should 
be  with  these  sets.   Then  all  other  sets  generated  by  these 
Tty-sets  will  automatically  be  assigned  a  probability.   So 
we  restrict  our  work  to  the  Tty-sets  hoping  to  discover  some 
criteria  for  assigning  probabilities  in  our  non-separable 
process. 

Prom  the  preceding  paragraph  we  already  have  two 
conditions:       .    ( 

1)  Altering  the  probability  of  a  set  affects  the 
probability  of  all  subsets. 

2)  Altering  the  probability  of  a  set  affects  the 
probability  of  at  least  one  superset. 

We  have  another  criterion  which  is  obtained  from 

the  manner  in  which  we  extended  our  c-algebra  S.   Suppose 

r  4-  r  and  s  +  s.   Then 
n  n 


(11)     lim  M   (      }  -  M   (    y 
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which  can  be  easily  shown.   If  r  +  r  and  s   +  s  it  is 

n  n 

false   that   the   lim  M      ,  %    =   Mn    r        -. .      We   reason  this 

n-voo        >      n     n  '      ' 

CO 

in  the  following  manner:   Since  lim  Mn  ,  v  =  II  1YL  ,     x, 

n-»     Mrn.»a)        n=l   ^Vn* 

oo 

to   say   that     U      M      ,  >>    =   Mn     ,        n    we  mean  that    for  any 

'     n     n  '      ' 

w  G  mt  rr,  ci»  we  have  that  co  z   M -,  /    _  n  for  some  n.   If 
'   '  '   n5  n 

we  choose  u  e  MQ ^  [Q  ^fll^  ^  [p  jS]nM0}  (g  ^^  ,  then  certainly 

w  e  M,  r-r,   oi  but  w  i  Mi  ^r.  «  ^  for  a11  n-   Thus, 
J-jLr,sj  '   n  n 

lim  M,  /     v  %   M,  r    -i.   However,  from  (11)  we  have  that, 
n-voo    »   n '  n      3   5 

3)   If  r  +  r  and  s   +  s,   then 
n  n    * 

lim  P(k,    ,        c    x)    =   P(]VL     ,         s).      We   term  this   third 
n-x»  *      n     n  '      * 

condition  our  "continuity  condition". 

Let  us  consider  an  example  of  an  assignment  of 
probabilities  in  a  non-separable  process,  where  the  assign- 
ment is  consistent  with  the  three  criteria  we  have  established. 
In  a  particular  non-separable  process  we  will  make  the 
assignment  of  probabilities  to  our  ^(-sets  in  the  following 
manner: 


P(Ml,(r,s)>  "  < 


^.(r.s)5  lf  (r,S)c[0,to/2) 

2-2(s-r)/to  ?(M1;(rjS))  if  (r,s)c(^,to) 

2l-(2s/t0)  p(M      A    otherwise. 
*■  J-j\.r,sj 
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To  those #7-sets  in  which  the  value  is  0  throughout  the 
interval,  we  use  the  same  assignment  of  probabilities.   It 
is  easily  verified  that  such  an  assignment  is  consistent 
with  the  three  criteria.   However,  let  us  examine  the  process 
more  closely.   We  introduce  the  functions  a,  3,  and  y 
defined  by, 


•  a((^s))  =  P(Ml,(r,s)) 
3((r,s))  =  -log(a((r,s))) 

y(s)  =  3((0,s)). 

We  observe  that  £((r,s))  =  y(s)  -  y(r)j  and  because  of 
the  assignment  of  probabilities,  our  y   function  is  more 
precisely  defined  by, 


t 
as   if   s  <  -y- 


o 


Y(B>-1     t  t 

2(s~)log(2)  +  as   if   s  >  —■ 

*  -afs-r") 

since  P(M1  ,    >.)  =  e       ,  where  a  is  the  value  obtained 

at  the  beginning  of  this  chapter.   The  graph  of  the  function 
looks  like: 
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Log(2)+at 


at0/2 


Though  this  approach  worked  nicely  for  this  example,  the 
approach  will  fail  when  a  particular  assignment  gives 
probability  0  to  some^-set,  say  1YL  T,  in  which  case  3(1) 
has  value  °°,  and,  hence,  y   is  not  finite.   With  y   not 
finite,  consistency  tests  must  be  handled  more  delicately. 

It  is  now  our  interest  to  look  for  finer  conditions, 
and  we  shall  do  so  by  looking  at  our  assignments  from  a 
different  vantage  point.   Noting  that  there  is  a  relation- 
ship between  the  probabilities  of  a  set  and  the  probabilities 
of  its  subsets  and  supersets,  we  may  think  of  the  ratio  of 
the  separable  probability  over  the  non-separable  probability 
of  an  7^-set  as  a  function  of  the  endpoints  of  the  Z^-set's 
interval.   This  ratio  is  what  we  will  call  the  factor 
function  P(',-),  and  write  the  probability  of  an  7^-set 
in  the  following  form: 


P(M 


l,Cr.B>>  "  P(r's)  P(Ml,Cr,s)>- 


Now  we  wish  to  characterize  the  function  F.   One 
obvious  condition  that  F  must  satisfy  is, 
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1)  0  <  F(r,s)  <_   1. 

We  obtain  another  condition  by  examining  the  relationship, 

F<^)?(Mlj(rjS))  =  P(M1>(rjS))  =  P(M1)(r)t))P(MMtjS)) 
=  F(r,t)?(Mlj(rjt))F(t}s)?(Mlj(tjS)) 
=  F(r,t)F(t,s)HMlj(rjt))?(Mlj(t}S)) 
=  F(r,t)F(t,s)P(M1  (r  s)) 
where  r  <  t  <  s.   Thus,  we  have  a  second  condition: 

2')   F(r,s)  =  F(r,t)F(t,s)    for  all  r  <  t  <  s. 

Since  the  interval  (r,r)  is  actually  the  void  set,  we  know 

that  P(M,  ,    >.)  =  P(ft)  =  1.   So  F(r,r)  =  1  for  all  r,  and 
■L a  ^r  ,r  j 

we  may  write  condition  (2')  as 

2)  F(r,s)  =  F(r,t)F(t,s)    for  all  r  <  t  <  s. 

A  third  condition  is  derived  from  criterion  (3)  stated 
earlier;  we  have 


3f)      If  r     4-   r  and   s      +    s,    then   lim  F(r    ,s    )    =   F(r,s). 

n  n  '  u n'  n 

n->oo 
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An  equivalent  statement  of  (3f)  is 

3)   F(r,s)  is  right  continuous  in  r,  and  left 
continuous  in  s. 

The  factor  function  of  the  example  presented  earlier  can 
be  shown  to  satisfy  these  three  conditions. 

From  conditions  (1)  and  (2),  we  note  that  F  is 
non-increasing  for  increasing  s  or  for  decreasing  r.   A 
subsequent  result  is  that  F  is  an  upper-semicontinuous 
function,  which  we  will  show.   Choose  c  >  0,  and  consider 
the  set  { (r,s) |F(r,s)<c}  =  W.   If  (r,s")  e  W,  there  exists 
6  >  0  such  that  F(r+6,s-6)  <  c,  by  criterion  (3).   Since 
F  is  non-increasing  for  increasing  s  or  for  decreasing  r, 
the  northwest  region  of  our  domain  with  respect  to  the 
point  (r+6,s"-6)  is  contained  in  W.   In  particular  there 
is  an  open  area  in  this  northwest  region  containing  (r,s) 
Thus,  W  is  open.  .Therefore,  F  is  an  upper-semicontinuous 
function. 

Now  let  ^  =  {F|F  satisfies  conditions  (1),  (2), 
and  (3)).   Let  F  be  a  decreasing  sequence  in  f-  .   Since 
each  F  is  bounded,  the  sequence  converges  to  some  F.   We 
wish  to  show  that  F  is  also  in  ^ .   Since  the  sequence  is 
in  t  ,  for  each  n, 


F  (r,s)  =  F  (r,t)  F  (t,s)    for  all  r  <  t  <  s. 
n  *      n  '    n  '  —   — 
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we  know  also  that  lim  F  (r,s)  =  F(r,s)   and  that 

n-*°°  n 


lim  (F  (r,t)  F  (t,s))  =  F(r,t)  F(t,s). 

n+oo 


Thus,  F(r,s)  =  F(r,t)  F(t,s)   for  all  r  <_  t  <  s ,  so 
condition  (2)  is  satisfied.   For  condition  (3),  let  r,  4-  r. 
Then  for  all  n, 


lim  F  (r  ,s)  =  F  (r,s). 

k+oo   n    K  n 


Choose  e  >  0.   For  some  n,  |F— (r,s)  -  F(r,s)|  <  p-  .   Now 

there  exists  a  k  such  that  for  all  k  >  k5 

|F-(r,  ,s)  -  F-(r,s)|  <  e.   We  note  that 
•'  n  k '      n   *   '    j 


F-(r,  ,s)  >  F(r.  ,s)  >  F(r,s)   for  all  k  >  k. 
n  k    —    k'   —    ' 


Thus,   |F(rk,s)  -  F(r,s)|  <  |F^rk,s)  ~  F(r's)l 


<  |P-(rk,s)  -  F-(r,s)|  +  |F-(r,s)  -  F(r,s)| 


<  |  +  |  =  e,    for  all  k  >  k(n(e))  =  k(e). 


Therefore,  lim  F(r,  ,s)  =  F(r,s),  likewise  for  s,  and 

condition  (3)  is  satisfied.   Obviously,,  condition  (1)  is 
satisfied,  giving  us  the  desired  result  that  F  e  ^f   .   A 
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stronger  conjecture  is  that  each  function  in  ^   is  the 

limit  of  a  decreasing  sequence  of  continuous  functions 

in  r •   It  remains  to  be  proved. 

We  may  picture  the  domain  of  the  functions  in  t 

by  considering  r-s  coordinate  system,  where  r  and  s  range 

from  0  to  t  .   Since  s  is  never  less  than  r.  the  domain 
o  ' 

of  each  F  is  the  triangular  region  bounded  by  the  lines 
r  =  0,  s  =  t  ,  and  r  =  s.   We  illustrate: 


By  the  argument  used  earlier,  F(r,r)  =  1  for  all  r.   Thus, 

the  value  of  F  along  the  line  r  =  s  is  1  for  any  assignment 

of  probabilities. 

Now  suppose  that  for  a  particular  pair,  r  ,s  , 

F(r  ,s  )  =  0.   Looking  at  our  coordinate  system,  all  points 

to  the  northwest  of  (r  ,s  )  have  value  0  under  the  function 

os  o 

F.   By  the  same  reasoning  if  F(r,s")  >  0,  then  all  points 
to  the  southeast  of  (r,s")  have  values  greater  than  0  under 
the  function  F.   We  also  know  that  since 
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P(r  ,s  )  =  F(r  ,s  -6)  F(s  -6,s  )  =  0,   then  either 
OO         00         oo 


F(rQ,so-6)  =  0,  or  F(sq-6,so)  =  0. 


Thus,  there  exists  some  point  of  value  0  under  F  along  the 

two  lines  which  form  the  boundary  of  all  the  points  to  the 

southeast  of  (r  ,s  ).   Suppose  it  is  the  point  (r  ,s  -6). 

o   o  r       o  o 

By  condition  (3),  all  points  between  (r  ,s  -6)  and  (r  ,s  ) 
"  '  r  0   0  oo 

have  value  0  under  F.   If  we  add  on  an  additional  property 
that  for  all  e^ep  >  0,  F(r  +e,,s  -£p)  >   °j  we  can  argue 
that  for  y  such  that  0  <  y   <   6 ,  and  all  e  >  0, 


F(r  ,s  -S-e)  F(s  -6-^s  -6+y)  =  F(r  ,s  -6+y)  =  0. 
:o5  o         o   ^  o    '       o'o    ' 


Since  F(s  -6-e,s  -6+y)  >  0  by  hypothesis,  F(r  ,s  -6-e)  =  0 
o      o    '  *  'oo 

for  all  e  >  0.   Therefore  with  the  added  property,  all 

points  between  (r  ,s  )  and  (r  ,r  )  have  value  0  under  F. 
*  o'   o        oJ  o 

If  (s  -6,s  )  is  the  point  having  value  0  under  F,  instead 

of  (r  ,s  -6),  the  same  arguments  would  hold  for  the  points 
oo 

between  (r  ,s  )  and  (s  ,s  ). 
o  o        o  o 

Consider  the  following  set  of  points  along  a  path,  A, 
in  the  domain  of  F.   From  this  path  we  form  the  regions 
X,  Y,  and  Z.   If  we  specify  arbitrary  positive  values  to 
all  points  on  path  A,  and  if  these  values  are  consistent 
with  the  three  conditions  of  F,  then  we  may  argue  that  all 
points  in  the  regions  X,  Y,  and  Z  have  values  determined 
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by  the  values  along  the  path  A.   For  example,  consider  a 
point,  (r,s),  in  the  region  X.   We  have  that 


F(u?,s)  =  P(Up,r)  F(r,s),    by  condition  (2). 


Since  we  have  specified  the  values  for  F(up,s)  and  F(up,r), 
F(r,s)  is  forced  to  assume  a  particular  value.   We  may  use 
the  same  argument  for  all  points  along  the  northern  border 
of  X,  which  is  a  continuation  of  the  horizontal  line  in 
path  A.   Thus,  all  points  between  (u..  ,  v  )  and  (v,  ,v..  )  have 
a  specified  value,  and,  hence,  we  may  determine  the  values 
in  the  region  Y  in  the  same  manner  as  we  did  in  the  region 
X.   Now  we  have  values  for  all  points  between  (u,,v  )  and 
(u,  ,u-.),  and,  therefore,  we  may  determine  the  values  in 
the  region  Z.   From  this  result  we  conclude  that  it  is 
sufficient  to  define  our  function  F  only  along  a  path  such 
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as  A  in  order  to  define  the  function  in  the  smallest 
southeast  region  containing  the  path. 

From  this  development  of  the  function  P,  we  conclude 
our  work  with  a  series  of  results. 

Lemma  1 :   If  F(r,s)  >  0,  then 

i)  F(r,*)  is  continuous  on  [r,s] 
and,         ii)  F(.,s)  is  continuous  on  [r,s] 

Proof:   For  i)  we  know  that  for  s  e  [r,s], 
lim  F(r,s-6)  =  F(r,s).   Since  F(i~+6,s)  >  0  for  all  6  >  0, 

and  since  the  lim  F(s+6,s)  =  F(s,s)  >  0 
6+0 


lim  F(r,s+6)  =  lim  (F(r ,s )/F(s+6 ,s) )  =  F(r,s). 
6+0  6+0 


Thus,  i)  is  true,  and  similarly,  ii)  is  true. 

Since  F  is  continuous  along  the  line  r  =  s,  by 
Lemma  1,  F  is  continuous  on  all  the  boundary  of  a  triangular 
region  in  the  domain  of  F.   Thus, 

Lemma  2 :   If  F(r,s)  >  0,  then  F  is  continuous  on 
the  closed,  southeastern  region  of  the  point  (r,s). 

The  lemma  follows  since  the  boundary  values  determine 
the  interior  values. 
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Theorem:   If  lim  F(r,s)  >  0,  then  lim  F(r,s)  =  F(r  ,s  ) 

r+r  r-*r 

o  o 

s+s  s+s 

o  o 


Proof:   If  lim  P(r,s)  >  0,  then  there  is  a  neighbor- 

r+r 
o 

s+s 
o 

hood  about  (r  ,s  )  such  that  F  is  positive  in  this  region, 
o  o  to 

In  particular,  F  is  positive  at  some  point  in  the  neighbor- 
hood which  is  northwest  of  (r  ,s  ).   Thus,  by  Lemma  2,  F 

o  o 


is  continuous  at  the  point  (r  ,s  ). 

*      o*  o 


Corollary:   The  lim  F(a — ,a+— )  either  equals  0  or  1. 
n_Hx>     n   n 

Proof:   If  for  some  N,  F(a-~,a+~0  >  0,  then  by 
N   N 

Lemma  2,  F  is  continuous  at  (a, a).   Thus 

lim  F(a — ,a+— )  =  F(a,a)  =  1.   If  no  such  N  exists,  then 
n-K»     n»   n 

for  all  n,  F(a--,a+-)  =  0.   Thus,  lim  F(a--,a+-)  =0,    _  . 
'     n'   n  ^^     n5   n     3 

and  the  corollary  is  proved. 


Corollary:   The  probability  of  the  event 

{lim  xe  =  1}   is  either  0  or  P(x.  =  1).   That  is  to  say, 

ts  x> 

the  sample  paths  passing  through  1  at  time  t  are  either 
almost  all  continuous  or  almost  all  discontinuous. 


l\2 


Proof:      Consider  the    set   Q      =  M,     ,.    1  fc+l\ ,    and 


n'      n 


let  Q  =  U   Q  .   The  event  Q  is  not  the  same  as  the  event 


n 

n=l 


{x,  =  1}.   But  from  the  previous  corollary,  P(Q)  =  P(x,  =  1), 
unless  the  Q  's  are  null  sets,  in  which  case  P(Q)  =  0. 


^3 


CONCLUSION 

In  the  non-separable  process  we  have  reduced  the 
probability  of  some  (or  all)  of  our  #?-sets  with  respect  to 
its  separable  probability.   Since  the  probability  of  an 
^-set  cannot  be  greater  than  its  separable  probability, 
an  interesting  question  is  which  events  in  the  non-separable 
process  have  their  probabilities  increased  when  the 
probability  of  an  Tty-set   is  decreased.   We  do  know  that 
such  events  belong  to  the  class  of  sets  in  which  an 
"infinite  number  of  transitions"  have  taken  place  over  an 
interval.   However,  such  events  have  separable  probability 
0.   Since  the  factor  function  F  -  approach  seemed  to  answer 
many  vague  ideas  about  non-separability,  perhaps  with  a 
fuller  characterization  of  F,  such  questions  as  that 
mentioned  above  may  be  answered. 


kk 
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parameter  stochastic  processes.   It  explores  the  implications  of 
relaxing  the  separability  hypothesis.   Various  numerical  results 
are  obtained  for  a  particular  example,  the  0-1  Markov  process. 
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